Film image input method and system thereof

ABSTRACT

The present invention relates to a film image input method, wherein a line sensor is used as an image sensor to reduce the cost, and the image data can be corrected in accordance with the taking environment, which occurs in a case of using the line sensor, for every frame. A line sensor is provided in which photoelectric transfer elements are arranged in a direction perpendicular to a feeding direction of a long roll of developed film for a still camera, the film is fed at the first speed continuously to take the rough image data of all frames through the line sensor, and the taking environment for every frame is detected based on the taken rough image data. Thereafter, when reproducing one frame, the film is fed at the second speed which is lower than the first speed, whereby the fine image data of the desired frame are adjusted in accordance with the detected taking environment of the frame and stored in the CCD buffer, and then the image signals are output to the TV monitor based on the stored fine image data.

This application is a divisional of copending application Ser. No.08/847,242, filed on May 1, 1997, now U.S. Pat. No. 5,754,221, which isa Rule 62 Continuation of U.S. application Ser. No. 08/360,433 filedDec. 21, 1994, now abandoned, the entire contents of which are herebyincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a film image input method and a systemthereof, more particularly to a film image input method and a systemthereof wherein an image of a developed film for a still camera isfocused on an image sensor through a taking lens and image signals,which are transferred photoelectrically by the image sensor, are outputon a TV monitor, whereby the image of the film is replayed on the TVmonitor.

2. Description of the Related Art

Conventionally, a film image input system wherein a developed film for astill camera is focused by an image sensor such as a CCD and an image ofthe film is transferred into image signals, thereafter, the imagesignals are output to the TV monitor and the image of the film isdisplayed, is disclosed in WO90/04301, Japan Patent ApplicationLaid-Open No.5-75922, Japan Patent Application Laid-Open No.5-56345,Japan Patent Application Laid-Open No.5-22656 and the like.

WO90/04301 discloses a camera and film image input system which use aphoto film provided with a magnetic recording track and Japan PatentApplication Laid-Open No.5-75922 discloses a film image input systemwhich uses a film cartridge wherein a developed film for a still camerais wound around a single spool.

Japan Patent Application Laid-Open No.5-22656 discloses a film imageinput system wherein when an instruction is given to make a multipicture (hereinunder, called an index image), a developed film for astill camera is wound or re-wound every one frame and the image date ofevery frame is taken through the image sensor and compressed to memorizein an image memory for one picture the index image is displayed on theTV monitor based on the image data memorized in the image memory.

Further, there is another conventional film image input system providedwith a zoom lens and scan mechanism for taking out only necessary imagerange within one frame of the film to magnify (for trimming), an imagesensor rotating mechanism for changing the length and breadth of thefilm image or the like.

In a conventional film image input system, when the image displayed onthe TV monitor is edited (for example, the length and breadth of theimage is changed, a format such as a high-vision size, a panoramic sizeand an ordinary size corresponding to the ratio of the length to thebreadth of the image is specified, or the display/non-display frame isspecified in case of displaying all frames in sequence), the image forone frame is displayed on the TV monitor thereby to edit the image whilemonitoring.

Then, in the conventional film image input systems, a two-dimensionalimage sensor is used as an image sensor, so that the brightness, thewhite balance and the like which vary with the taking environment can becorrected at real time to obtain the image data. However, there is aproblem in that a two-dimensional image sensor is more expensive than aone-dimensional sensor (a line sensor).

When the image data for one frame of the photo film which is fedcontinuously is taken with the line sensor and the still picture isdisplayed on the TV monitor based on the image data, there is anotherproblem in that a fine image data of which the brightness, the whitebalance and the like have been corrected can not obtained though theimage data for one frame is taken once, since the image data can not beobtained at real time like a two-dimensional image sensor.

Further, in the conventional film image input systems, when the imagedisplayed on TV monitor is edited, the image for one frame is displayedon the TV monitor and then the image is edited while monitoring. Thus,there are other problems in that all frames photographed in the film cannot be story-edited easily and effectively because a plurality of framesare not displayed on the TV monitor at the same time.

Japan Patent Application Laid-Open No.5-22656 gives a description ofthat in which an index image is produced and displayed. However, theindex image is used for selecting a desired frame to be displayed on theTV monitor, not for editing.

Incidentally, the above-described index image can be used for editing,however, the conventional film image input system uses a two-dimensionalimage sensor. Thus, to produce the index image, the film must be woundor rewound one frame at a time and the image data for every frame mustbe taken by the image sensor during stopping of the film, whereby muchtime is taken for taking in the image data of all frames in one film.

SUMMARY OF THE INVENTION

The present invention has been developed to eliminate theabove-described problems and has as its aim the provision of a filmimage input method and a system thereof wherein a line sensor is used asan image sensor to reduce cost, and the correction of the image data,which becomes necessary when a line sensor is used, can be done quicklyin accordance with the taking environment for every frame.

Further, the present invention has as its aim the provision of a filmimage input method and a system thereof wherein an index image can bemade in a short time, and continuous images can be edited easily whilemonitoring the index image.

To achieve the above-described object, a film image input methodincludes: providing a line sensor in which photoelectric transferelements are arranged in a direction perpendicular to a feedingdirection of a long roll of developed film for a still camera; takingrough image data of all frames through said line sensor by feeding saidfilm continuously at a first speed; detecting taking environment ofevery frame based on said rough image data which are taken; thereafter,adjusting fine image data of a desired frame based on said takingenvironment of the frame which is detected and taking them through saidline sensor by feeding said film at a second speed which is lower thanthe first speed while reproducing one frame; and, outputting imagesignals on a TV monitor based on the fine image data which are taken.

Moreover, a film image input method includes: reading magnetic data froma magnetic recording layer of the film during feeding the filmcontinuously and reproducing a film image based on the read magneticdata.

Further, a film image input method includes: displaying index images ona TV monitor by outputting image signals showing index images of pluralframes on a TV monitor based on said image data of all frames which aretaken; setting a display method and the like with monitoring an indeximage displayed on the TV monitor and storing set data showing a settingthereof; thereafter, outputting image signals which are processed inaccordance with setting data of a frame during reproducing based on theimage data of a desired frame.

According to this invention, a line sensor is used instead of anexpensive two-dimensional image sensor and a developed film is fed at aconstant speed, whereby an image data is taken through the line sensor.Before taking in the desired image data, a rough image data of allframes is taken by feeding the film at the first speed continuously andthe taking environment such as a brightness of every frame and a whitebalance are detected based on the taken image data.

When one frame is reproduced, the film is fed at the second speed whichis slower than the first speed. Then, a fine image data of the desiredframe is taken through the line sensor while the exposure, the whitebalance and the like are adjusted in accordance with the detected takingenvironment of the frame.

While reproducing the magnetic record, it is required that the relativespeed between the magnetic head and the record medium is higher than aspecific speed, and the magnetic data is read from the magnetic recordlayer or the magnetic data is written into the magnetic record layerwhen the film is fed continuously at the high first speed.

Further, index images are made based on the pre-taken image data of allframes by feeding the film continuously, and the image signals showingthe index images are output to the TV monitor, whereby the index imagesare displayed on the TV monitor. Then, the display method of every frameand the like are set while monitoring the index images displayed on theTV monitor, and the setting data is memorized, whereby the respectiveframes are edited at a time. Thereafter, when one frame is reproducedbased on the image data of the desired frame, the setting data of theframe edited as above-mentioned is read and the image signals which areprocessed in accordance with the setting data are output to the TVmonitor.

BRIEF DESCRIPTION OF THE DRAWINGS

The exact nature of this invention, as well as other aims and advantagesthereof, will be readily apparent from consideration of the followingspecification relating to the accompanied drawings, in which likereference characters designate the same or similar parts throughout thefigures thereof and wherein:

FIG. 1 is a perspective view showing the schematic structure of a wholesystem including a film image input system according to the presentinvention;

FIG. 2 is a view showing an example of a film cartridge employed in thefilm image input system shown in FIG. 1;

FIG. 3 is a block diagram showing an example of an internal structure ofthe film image input system shown in FIG. 1;

FIG. 4 is a flow chart explaining the action of the film image inputsystem shown in FIG. 1;

FIG. 5 is a view showing an example of the feeding sequence of the filmwhich is fed in the film image input system shown in FIG. 1;

FIG. 6 is a view showing another example of the feeding sequence of thefilm which is fed in the film image input system shown in FIG. 1; FIG.7(A) is a view showing a memory area in a CCD buffer, FIG. 7(B) is aview showing a memory area in a display buffer, FIG. 7(C) is a viewshowing a image displayed on the TV monitor and FIG. 7(D) is a viewshowing a memory area of one frame in a CCD buffer of the film imageinput system shown in FIG. 1;

FIGS. 8(A) and 8(B) are views explaining the process of the index imagesof the film taken by a normal camera and FIGS. 8(C) and 8(D) are viewsexplaining the process of the index images of the film taken by apre-wind type camera;

FIGS. 9(A) and 9(B) are views explaining the skip setting with indeximages:

FIG. 10(A) and 10(B) are views explaining the length and breadth settingwith the index images;

FIG. 11 is a view explaining the setting of the print number for everyframe with the index images;

FIG. 12 is a view showing an example of the monitor picture in thesetting mode of the one frame reproducing menu;

FIGS. 13(A), 13(B) and 13(C) are views explaining the setting of theprint number and the like of the displayed frame;

FIGS. 14(A) and 14(B) are views explaining the setting of theenvironment of the displayed frame;

FIGS. 15(A) and 15(B) are views showing one frame divided into nineareas with the data indicating the brightness of the respective areasand a mark indicating the upright position; and,

FIG. 16 is a flow chart explaining an automatic distinction of theupright position for every frame.

DESCRIPTION OF THE PREFERRED EMBODIMENT

A detailed description will hereafter be given of the preferredembodiment of film image input method and system thereof according tothe present invention with reference to the accompanying drawings.

FIG. 1 is a perspective view showing the schematic structure of a wholesystem including a film image input system according to this invention.As shown in FIG. 1, a film image input system 100 is shaped in arectangular parallelepiped, and a film cartridge tray 102 and a powerswitch 104 are provided at the front thereof. The film cartridge tray102 is driven back and forth during the loading/unloading of a filmcartridge 110, whereby the film cartridge 110 can be stored or takenout.

A key pad 120 and a TV monitor 109 are connected to the film image inputsystem 100, and various control signals, which control the film imageinput system 100, are output from the key pad 120 to the film imageinput system 100 through a signal cable 106 and video signals are outputfrom the film image input system 100 to the TV monitor 109 through asignal cable 108. And detailed description will be given later of thefilm image input system 100 which is controlled by the key pad 120.Further, In this embodiment, the control signals are output from the keypad 120 through the signal cable 106, however, it is not limited to thisonly, but an infrared remote-control transmitter and receiver may beprovided on the key pad 120 and the film image input system 100,respectively, and the control signals from the key pad 120, which areremote-control signals, may be transmitted to the film image inputsystem 100.

The film cartridge 110 has a spool 112, as shown in FIG. 2, and a film114 is wound around the spool 112. In the film 114, perforation 114A,which indicates a frame position, is projected and a magnetic recordinglayer 114B, on which magnetic data showing photographing data of everyframe can be recorded by a camera having a magnetic head, is placed onthe whole or at the edge of the film. Further, the developed film 114 iswound in the film cartridge 110 to thereby be kept.

In a camera applied to the film cartridge 110, various magnetic data forevery frame can be recorded on the magnetic recording layer 114B of thefilm 114 by using the magnetic head which is built into the camera.Magnetic data to be recorded include a frame number, a print formatindicating a high-vision image, a panoramic image or an ordinary sizeimage, a photographed day/time, a normal-wind/a pre-wind indicating thefilm wind direction during the photographing with the camera and thelike, and further, various data can be recorded in accordance with acamera. Moreover, a bar code indicating a film type, a frame number andthe like can be recorded optically on the outside of the frame which isexposed by the object light and data indicating a print format and thelike can be recorded optically on the outside of the frame by the lightsource built into the camera during the photographing.

FIG. 3 is a block diagram showing an embodiment of the internalstructure of the film image input system 100. The film image inputsystem 100 comprises a light source 130 for lighting, a taking lens 136,a CCD circuit unit 140 including a CCD line sensor 140, a first signalprocessing circuit 151, a second signal processing circuit 152, a thirdsignal processing circuit 153, a memory control circuit 154, a CCDbuffer M1, a display buffer M2, a central processing unit (CPU) 160, afilm driving mechanism 170, an optical data reading system 180, amagnetic record reproducing system 182 and the like.

The light source 130 consists of, for example, a fluorescent light whichis in a longitudinal direction, perpendicular to the feeding directionof the film 114, and illuminates the film 114 through an infrared lightcutting filter 132. The image light which permeates through the film 114is focused on the light receiving surface of the CCD line sensor 142through the taking lens with a focal point. The film 114 is moved in thedirection of the arrow A (hereunder, the sequential direction) or in thedirection of the arrow B (hereunder, the reverse direction) by the filmdriving mechanism 140 when the film image is picked up by the CCD linesensor 142. A detailed description as to the film driving will be givenlater.

The CCD line sensor 142 is placed in the direction perpendicular to thefilm feeding direction. The image light focused on the light receivingsurface of the CCD line sensor 142 is charged and stored at each sensorwhich has a R, G or B filter for a predetermined time, and converted toa signal charges of R, G or B in accordance with the intensity of thelight. The stored signal charges are read to a shift resistor with alead gate pulse having a predetermined cycle from the CCD drivingcircuit 144, and is read by the resistor transmitting pulse,sequentially.

The CCD line sensor 142 has, for example, sensors for 1024 pictureelements in the direction perpendicular to the film feeding direction.Further, when the cycle of the lead gate pulse or the like is unchanged,the number of the picture elements in the film feeding direction of oneframe varies in accordance with the film feeding speed. In thisembodiment, when the film feeding speed is a half, one, eight andsixteen times of the standard speed, the number of the picture elementsbecomes 1792, 896, 112 and 56, respectively.

With this arrangement, the signal charges which are read from the CCDline sensor 142 is clamped with a CCD clamp, and input to an analogprocessing circuit 146 as the R, G, B signals and the gain and the likeof the R, G, B signals are controlled. The R, G, B signals output fromthe analog processing circuit 146 are point-sequenced by a multiplexer148 and converted to digital signals by an A/D converter 150,thereafter, output to the first signal processing circuit 151 and theCPU 160.

The first signal processing circuit 151 includes a white balanceadjustment circuit, a negative-positive changing circuit, a γ-correctingcircuit, a RGB synchronizing circuit and the like, and processes thepoint sequenced R, G, B signals, which are input sequentially, in therespective circuits, and then outputs the synchronized R, G, B signalsto the second signal processing circuit 152. Further, the white balanceadjustment circuit in the first signal processing circuit 151 processescontrol signals from the CPU 160, a detailed description will be givenlater.

The second signal processing circuit 152 has a matrix circuit, andproduces a luminance signal Y a chromatic signal Cr/b and output them toa memory control circuit 154.

The memory control circuit 154 controls the luminance signal Y and thechromatic signal Cr/b which are written/read to the CCD buffer M1 andthe luminance signal Y and the chromatic signal Cr/b, which arememorized in the buffer M1, which are written/read to the display bufferM2. A detailed description will be given of the control to thewrite/read for the CCD buffer M1 and the displays buffer M2, later.

The luminance signal Y and the chromatic signal Cr/b, which are readfrom the display buffer by the memory control circuit 151, are output tothe third signal processing circuit 153. In the third signal processingcircuit 153, color combined image signals of a mode such as NTSC mode,are produced, and then output to a video output terminal 158 through theD/A converter 156. Synchronized signals having predetermined cycles areoutput from a synchronized signal producing circuit 159 to the memorycontrol circuit 154, the third signal processing circuit 156 and the D/Aconverter 156, respectively, whereby the respective circuits can besynchronized and image signals including required synchronizing signalscan be received. Timing signals, which are controlled by the CPU 160,are output to the CCD circuit unit 140, the A/D converter 150, the firstsignal processing circuit 151, the second signal processing circuit 152and the memory control circuit 154 from a timing signal producingcircuit 162, respectively, whereby the respective circuits aresynchronized.

The film driving mechanism 170 is fixed to the spool 112 in the filmcartridge 110 and is positioned in a film feeding portion which drivesthe spool 112 clockwise/counterclockwise, a film winding portion whichwinds the film 114 from the feeding portion and a film conveying path,and further is composed of a mechanism which feeds the film 114 is fedat a constant speed which can be held by a capstan and a pinchroller.The film feeding portion drives the spool 112 in the film cartridge 110clockwise in FIG. 3 to thereby feed the film 114 from the film cartridge110 until the film top is wound by the film winding portion.

The optical data reading system 180 is composed of a first opticalsensor 180A for optically detecting the perforation 114A of the film 114and a second optical sensor 180B for optically detecting optical datasuch as a bar code written at the edge of the film, and then itprocesses the optical data which are detected by the optical sensors180A and 180B and then outputs it to the CPU 160.

In the magnetic record reproducing system 182 which has a magnetic head182A, the magnetic data, recorded on the magnetic recording layer 114Bof the film 114, are read through the magnetic head 182A, and thenprocessed and then output to the CPU 160 to be recorded in a RAM 160A.Further, the data, which are recorded in the RAM 160A of the CPU 160 areread and converted to signals to be available for magnetic recording,and then output to the magnetic head 182A and stored in the magneticrecording layer 114B of the film 114.

Next, the operation of the above-mentioned film image input system 100will be described while referring to the flow chart in FIG. 4.

First, the film cartridge 110 is set in the film cartridge tray 102, andthen the film driving mechanism 170 is controlled by the CPU 160 tothereby load the film (step 200). That is, the film 114 is fed from thefilm cartridge 110 and the film top is to be wound to the winding axiswhich is the film winding portion.

When the film loading is completed, the first pre-scan of the film 114is started. That is, as shown in FIG. 5, the film 114 is fed in theright direction (see FIG. 4) at the high speed, 148.0 mm/s, and thenrewound in the reverse direction at 148.0 mm/s. When the first pre-scanin the right direction is performed, the image data are taken throughthe CCD line sensor 142 and the optical data and the magnetic data areread through the optical data reading system and the magnetic recordreproducing system 182.

Next, a description is given of the process based on the image datawhich are taken during the first pre-scan.

The point-sequenced R, G, B signals are input to the CPU 160 from theA/D converter 150 shown in FIG. 3. In the CPU 160, the R, G, B signalsof all frames are taken, respectively, off-set values of the respectivecolor signals and gain adjustment values of the respective color signalsfor adjusting white balances are calculated, and then off-set datashowing the offset values of the respective color signals and AWB datashowing the gain values are stored in the RAM 160A in the CPU 160 forevery frame. Further, AE data, with which the brightness of every frameis shown by the R, G, B signals, are stored in the RAM 160A. And, theCPU 160 can detect every frame based on the optical/magnetic data, whichare input through the optical data reading system 180 and the magneticrecord reproducing system 182, and can detect also the frame number bycounting frames.

Then, the second pre-scan of the film 114 is performed. This is shown inFIG. 5; the film 114 is fed in the forward direction at the high speed,74.0 mm/s again, and then rewound in the reverse direction at 148.0mm/s. When the second pre-scan in the right direction is performed, theimage data are taken through the CCD line sensor 142 again. The CPU 160controls an aperture 134 every frame based on the AE data stored in theRAM 160A through a aperture control system 164 during the taking of theimage data. Further, when a sensor having an electric shutter mechanismis used as the CCD line sensor 142, the charge storage time in the CCDline sensor 142 is controlled through the CCD driving circuit 144,whereby exposure values can be adjusted, and as the result, the aperture134 and the aperture control system 164 are not needed.

The off-set values and the white balance of the R, G, B signals areadjusted every frame in the first signal processing circuit 151 by theCPU 160. That is, the CPU 160 outputs the off-set data, which are storedin the RAM 160A, of the respective frames and of the respective colorsignals to the first signal processing circuit 151, and then the off-setvalue of the point sequenced R, G, B signals are adjusted based on theoff-set data in the first signal processing circuit 151. Similarly, theCPU 160 outputs the AWB data, which are stored in the RAM 160A, of therespective frames and of the respective color signals to the firstsignal processing circuit 151, and then the AWB value of the pointsequenced R, G, B signals are adjusted based on the AWB data in thefirst signal processing circuit 151.

The image data of each frame are adjusted on the basis of the AE data,the AWB data and the like, therefore, fine image data can be takenwhether the taking condition of each frame is good or not.

The adjusted image data of each frame, that is, the luminance signal Yand the chromatic signal Cr/b which are output from the second signalprocessing circuit 152 are stored sequentially in the CCD buffer M1through the memory control circuit 154. The film 114 is fed at a speedeight times as fast as the feeding speed during the taking of thestandard film image, therefore, the number of the picture elements ofone frame in the film feeding direction is 112, as shown in FIG. 7(A).The CCD line sensor 142 has 1024 picture elements in the directionperpendicular to the film feeding direction, however, the number of thepicture elements of one frame in the direction perpendicular to the filmfeeding direction is reduced one sixteenth to thereby be 64. The CCDbuffer M1 has a capacity for storing the data of 512×10 pictureelements, as shown in FIG. 7(A), therefore, the image data of 5×4×2 (40)frames can be stored. That is, the image data showing the index imagesfor 40 frames are stored in the CCD buffer M1.

The CCD buffer M2 has a capacity for storing the data of 512×1024picture elements, as shown in FIG. 7(B). When the image data showing theindex images are stored, the number of the picture element in one frameis enlarged to 73×128 and the image data for 5×42 (20) frames can bestored. Then, the index image is displayed on the TV monitor 109, theupper left area in the display buffer M2 of 480×640 picture elements areread (see FIGS. 7(B) and (C)).

Now, in the CCD buffer M1, the image data of the respective frames arestored sequentially from the upper left to the right of the memory areain order that the image data of each frame during the scan can be read,and when the image data for 4 frames are stored, the following data arestored at the memory area of the next line from the left to the right,sequentially. Then, when the image data for 5 lines (4×5=20 frames) arestored, the following image data are stored in the next memory fortwenty frames.

The contents stored in the CCD buffer M1 are transferred to the displaybuffer M2 while storing contents in the CCD buffer M1, therefore, whenthe film cartridge taken by a normal wind type camera (an ordinarycamera) is set, the frame image is displayed from the left-upperportion, sequentially, as shown in FIG. 8(A).

The image data for the twenty frames are stored in the display buffer M2at once, therefore, when the image data of the twenty-first frame areinput to the CCD buffer M1, the image data are rewritten and read to thedisplay buffer M2 which scrolls the index images upward. For example, asshown in FIG. 8(B), when the image data of the twenty-first frame areinput to the CCD buffer M1, the image data for one line from the firstframe to the fourth frame in the display buffer M2 are cleared, and thenthe image data of the twenty -first frame is written and the scanstarting address while outputting the image signals is changed to thesecond line. With this arrangement, the index images, which are scrolledupward for one line, are displayed on the TV monitor 109. When the imagedata of all frames are stored in the CCD buffer M1, the screen of the TVmonitor 109 is scrolled downward or changed over to display thefollowing index images for the first twenty frames.

Now, in the CPU 160, frames are numbered in order that the respectiveimage data are read during the scan, that is, 1, 2 . . . , and charactersignals showing the respective frame numbers are output to therebydisplay the superimposed index images, as shown FIGS. 8(A)-8(D).

On the other hand, when the film cartridge, which is taken by thepre-wind type camera, is set, and for example, there are 40 frames, asshown in FIGS. 8(C) and 8(D) the superimposed index images having 40, 39. . . frame number are displayed from the lower-right side in thescreen. Therefore, the taking order of the respective frames and therespective frame numbers are the same.

Further, at least, when a film is taken with a pre-wind type camera,data showing the pre-wind type must be recorded optically ormagnetically on the film in order to display the index images incorresponding between the taking order of the respective frames and therespective frame numbers.

As stated above, the index images are prepared and displayed on the TVmonitor 109, thereafter, required editing and assignments are input withthe key pad 120 while monitoring the index images in order to displayone frame on the TV monitor 109 with the dialogue operation (step 204).

The key pad 120, as shown in FIG. 1, consists of eight keys, keys121-124 for an upright position, an UP key 125, a DOWN key 126, anExecute key 127 and a Cancel key.

Now, as shown in FIG. 9(A), the index images for twenty frames and wordsshowing various menus for settings are displayed on the TV monitor 109by the the CPU 160. PSET shows the number of prints to be set, ROTSshows the length and breadth of the frame to be set, SKPS shows thenon-displayed frame while reproducing to be set, VIEW reproduces oneframe by one frame, PLAY reproduces the respective frames at constantintervals, ENV shows an environment to be set such as an interval timeand a back color, and END shows that the editing with the index imagesis finished.

A cursor is moved to the required menu with the UP key 125 and the DOWNkey 126 of the key pad 120 (that is, the required menu is distinguishedwith the color), and then the Execute key 127 is pushed, whereby themenu is selected. When the menu is selected, the first frame is editedand the frame number thereof is displayed (the number is blinking). Theframe to be edited is selected with the keys 121-124 on the key pad 120.

Now, as shown in FIG. 9(A), the cursor is set on the SKPS and theExecute key 127 is pushed, whereby the skip setting menu is selected.

In the skip setting menu, as shown in FIG. 9(B), the non-displayed frameis set/released with the UP key 125 or the DOWN key 126. For example,when the frame of the frame number 1 is set as a non-displayed frame, itis selected as the frame to be edited and the UP key 125 is pushed.Then, the character for the SKIP is displayed in the frame of the framenumber 1. When the Execute key 127 is pushed, the memory areacorresponding with the frame number 1 in the display buffer M2 iscovered with the clear color and the data showing the frame number 1 ofthe non-displayed frame are stored in the RAM 160 the CPU 160. Further,the image data on the CCD buffer M1 is left, therefore, the DOWN key126is pushed and the character for the VIEW is displayed, and the theExecute key 127 is pushed, whereby the image data corresponding with theframe number 1 are transferred from the CCD buffer M1 to the displaybuffer M2. Thus the frame is displayed and the data showing the framenumber 1 of the non-displayed frame stored in the RAM 160A are cleared.With this arrangement, a display/non-display frame is set. The settingcan be canceled with the Cancel key 128.

Next, a description is given of the direction of the length and breadthof the frame.

As shown in FIG. 10(A), the cursor is set on the ROTS and the Executekey 127 is pushed to select the length and breadth setting menu.

When the length and breadth setting menu is selected, as shown in FIG.10(A), the frame number of the frame to be edited blinks and an arrowindicating the upright position is displayed in the image thereof. Whenthe UP key 125 is pushed once, as shown in FIG. 10(B), the direction ofthe arrow is rotated clockwise by 90°, and when the DOWN key 126 ispushed once, the direction of the arrow is rotated counterclockwise by90°. The upright position is selected by the arrow, and then when theExecute key 127 is pushed, the image data of the frame to be edited inthe memory area of the display buffer M2 are rotated in the selecteddirection. As shown in FIG. 7, since the number of the picture elementsin the length differ from that of in the breadth, the image is reducedin the case of rotating from the breadth to the length or the image isenlarged in the case of rotating from the length to the breadth.

Next, a description is given of the number of the prints for each framewhich is set.

As shown in FIG. 11, the cursor is set on the PSET and the Execute key127 is pushed to select the print number setting menu.

When the print number setting menu is selected, as shown in FIG. 11, theframe number of the frame to be edited blinks and the number of theprints is displayed in the image thereof. Previously, zero is displayedas the number of the prints, when the UP key 125 is pushed once, one isadded thereto, and when the DOWN key 126 is pushed once, one issubtracted therefrom. The number of the prints is selected, and thenwhen the Execute key 127 is pushed, the number of the prints is set andstored in the RAM 160A of the CPU 160.

Moreover, the print format corresponding to the ratio of the length andthe breadth, such as a high-vision size, a panoramic size and a normalsize, can be set for every frame. In this case, the ratio of the lengthand the breadth in the frame of the index image is changed in accordancewith the format setting, whereby the set format can be confirmed on theindex image.

Further, the frame changing-over method, wherein one frame is changedover to the following frame, can be set. For example, when the displayis changed from one frame to the following one, the frame changing-overmethod, such as a method of changing over display imagesinstantaneously, a method of scrolling a screen, and a method ofchanging over in a fadeout/fade-in mode, can be specified by monitoringthe index images.

The editing is finished, and then the cursor is set on the END and theExecute key 127 is pushed, whereby the editing with the index images iscompleted.

When the editing with the index images is completed, it is selectedwhether every frame is edited or not in the step 206 (FIG. 4). Thisselection can be done by operating the key pad 120 while monitoring theTV monitor 109.

Next, the description of every frame editing is given.

First, the display frame number is set to one (step 208), then as shownin FIG. 5, the film 114 is fed in a sequential direction at 9.25 mm/s byone frame and the frame having the frame number 1 is scanned (theregular scan) (step 210). Then, the image data are stored in the CCDbuffer M1 through the CCD line sensor 142 during this regular scan.

When the image data are stored, the image data of each frame areadjusted based on the AE data, AWB data and the like which are stored inthe RAM 160A by the CPU 160, therefore, fine image data can be obtainedirrespective of the taking environment of each frame. Further, thenumber of the picture elements for one frame, which are stored in theCCD buffer M1 as mentioned above, is 512×896, as shown in FIG. 7(D).That is, the output from the CCD line sensor 142 having sensors for 1024picture elements is thinned out to half, whereby the number of thepicture elements in the direction perpendicular to the film feedingdirection of one frame becomes 512, and further, the film feeding speedis reduced to one eighth of that of during the taking the image data ofthe index images, whereby, the number of the picture elements in thesame direction of the film feeding direction for one frame of thepicture images is eight times (896 picture element) as many as 112picture elements.

The image data, which are stored in the CCD buffer M1, are transferredto the display buffer M2, and the contents stored in the display bufferM2 are read repeatedly, whereby the image for one frame is displayed onthe TV monitor 109. Further, in the setting mode of one framereproducing menu, as shown in FIG. 12, the frame number is displayed atthe upper-left and the characters showing the setting menu required forone frame editing are displayed at the right on the TV monitor 109.Further, the FWD shows the following frame reproduction, the REV showsthe previous frame reproduction, the RST shows that the respectivesettings are reset and the re-scan is started, the ZOOM shows the zoomsetting, the MASK shows the mask setting, the ROT shows the setting ofthe length and the breadth of the frame, the SET shows the setting forthe number of the prints and the like, the IDX shows the display of theindex images, the ENV shows the setting of the environment, such as theinterval time and the back color, and the END shows the end of theediting with the image of one frame.

The cursor can be moved on the menu as required with the UP, DOWN keys125, 126 of the key pad 120 and the Execute key is pushed in the sameway as the editing with the index images, whereby the menu is selected.

Now, when the cursor is set on the ZOOM and the Execute key 127 ispushed, the zoom setting menu is selected (step 121). In the zoomsetting menu, a pointer is moved with the keys 121-124 for the up, down,left and right directions of the key pad 120 1, whereby the zoomingcenter is specified. Then, the UP key 125 or the DOWN key 126 is pushedto thereby zoom up or zoom out with an electric zooming. After therequired zooming, the Execute 127 key is pushed, and then the zoomsetting is decided and stored in the RAM 160A of the CPU 160. (step214). Further, when the images are printed out from a video printer, notshown, which is connected to the film image input system 100, that isinstructed from the printer (step 216).

Moreover, the above-mentioned electric zoom can cover the zooming range,for example, from a half to one and a half times. Then, when themagnification becomes 1.5 by the electric zoom and further the zoom upis instructed with the UP key 125, the regular scan is performed at alow speed. In this case, the film 114 is fed in the sequential directionat 4.63 mm/s (at a half speed of the normal regular scan) and the CCDoutput from the CCD line sensor 142 is stored based on the specifiedzooming center without thinning out. With this arrangement, the imagedata, which are zoomed twice as fast as the normal regular-scan, arestored. In the electric zoom, the maximum magnification is three times.

Further, a title, which is displayed and overlapped on the frame image,can be input with the key pad 120 (steps 218, 220) and thecharacteristic data showing the title are stored in the RAM 160A of theCPU 160. The cursor is moved on the MASK and the Execute key 127 ispushed, whereby an edge setting menu is selected, so that the positionand the size of the edge, which is provided around the display frame,can be input with the key pad 120 (steps 224, 226). When these inputsare decided, the images can be printed out from the video printersimilarly to the step 216 (steps 222, 228).

Next, a description is given of the number of the prints and the likewhich are set.

The cursor is moved on the SET and the Execute key 127 is pushed toselect the print number setting menu (steps 230, 232).

That is, when the print number setting menu is selected, as shown inFIG. 13(A), the SET and three object items, that is, PRINT 0, DATE ONand PLAY VIEW< are displayed on the image of the frame at the upperleft. These object items are selected by operating the up and down keys121, 122, and then the selected object items are in a blinking state.When the PRINT 0 is selected, the number of the prints can be specifiedwith the UP key 125 and the DOWN key 126, and when the DATE ON isselected, as shown in FIG. 13(B), it can be specified whether the takingdate is printed or not with the UP key 125 and the DOWN key 126, andfurther, when the PLAY VIEW is selected, as shown in FIG. 13(C), thedisplay/non-display (VIEW/SKIP) of the frame can be specified with theUP key 125 and the DOWN key 126. The number of the prints is specifiedin this way, thereafter, when the Execute key 127 is pushed, thedisplayed number of the prints is set and stored in the RAM 160A of theCPU 160. And, when the number of the prints, which is set with the indeximages, differs from the set in the one frame setting menu, for example,that set in the one frame setting menu is given priority.

Next, a description is given of the time interval time and the like ofthe display frame which are set.

The cursor is moved on the ENV and the Execute key 127 is pushed toselect the environment setting menu.

When the environment setting menu is selected, the image is muted andonly character of the INTERVAL TIME: 10 and BACK COLOR: BLACK aredisplayed, as shown in FIG. 14(A). These object items are selected withthe up and down keys 121, 122 and the selected items are blinked. Whenthe INTERVAL TIME: 10 is selected, the respective display times whiledisplaying frames continuously one by one can be specified with the UPkey 125 and the DOWN key 126, and when BACK COLOR: BLACK is selected, asshown in FIG. 14(B), the back color of the display frame can be selectedamong eight colors with the UP key 125 and the DOWN key 126. The timeinterval and the like are specified in this way, thereafter, when theExecute key 127 is pushed, the displayed time interval and the like areset and stored in the RAM 160A of the CPU 160.

The display frame is edited as the above-mentioned, and then when thecursor is moved on the END and the Execute key 127 is pushed, thedisplay frame editing is completed (step 234), and when the cursor ismoved on the FWD or the REV and the Execute key 127 is pushed, 1 isadded to or subtracted from the frame number (step 236) and the step isreturned to 210. With this arrangement, another display frame can beedited in the same way as mentioned above.

Now, when the display frame editing is completed (step 234), as shown inFIG. 5, the film 114 is fed in the sequential direction at the highspeed, 148.0 mm/s, the magnetic data which were previously read from themagnetic layer 114B in the film 114 and store in the RAM 160A of the CPU160, the data showing the contents of the editing with the index images,the data showing the contents of the editing with the display frame andthe like are stored in the magnetic layer 114B of the film 114 again(step 238). Then the film 114 is rewound in the reverse direction at thehigh speed, 148.0 mm/s and the film cartridge 110 is picked up (step240).

On the other hand, in the step 206, when the editing with the displayframe is not performed, the steps 242 and 244 are performed, and thenthe magnetic data are written in the magnetic layer 114B of the film 114and the film cartridge 110 is picked up as same as the steps 238, 240.

Further, not shown in the flow chart of the FIG. 4, the respectiveframes can be reproduced in accordance with the contents edited as aboveon the TV monitor 109 one by one or continuously at predeterminedintervals, and then therefore the film image can be enjoyed. When thefilm cartridge 110 which is edited once is loaded, the images can bereproduced on the TV monitor 109 in accordance with the edited contents.In this case, the magnetic data, the AE data, the AWB data and the likemust be read before reproducing at least one frame. Further, the filmfeeding sequence in the reproducing frame is changed in accordance withwhether the film taken by the normal wind type camera or by the pre-windtype camera, whereby the images can be reproduced in the taking order.

Now, in the film capable of recording magnetic and optical data, it isconsidered that the data of the same process are stored bothmagnetically and optically. The optical data, which are recordedoptically during the taking, can not be rewritten. However the magneticdata can be rewritten while editing. Thus, the case that the contents ofthe optical data differ from that of the magnetic data occur. Forexample, the data showing the high vision format are recorded opticallywith the camera while taking, thereafter, the data showing the panoramicformat are stored magnetically in the magnetic layer while editing.

Then, the optical data and the magnetic data, which are read by theoptical reading system 180 and the magnetic record reproducing system182 respectively, are input to the CPU 160 and the both data from thesame frame are compared. When it is detected that the different data forthe same process are stored, the process is performed based on thecontents of the magnetic data. When only the optical data are stored orerrors occur in the magnetic data, the process is formed based on theoptical data. When errors occur in the magnetic data, the magnetic datacan be corrected based on the optical data.

In this embodiment, the taking environment such as the brightness and awhite balance is detected for every frame while taking, however, thepresent invention should not be limited to this. For example when pluralframes having the almost same taking date are detected based on themagnetic data read from the magnetic layer in the film, the takingenvironment of these frames may be identified with that of the firstframe. Further, the almost same taking date means that the taking datesare the same, and the taken scenes are the same or the taking times ofthe respective frames are immediately equal at the level that the thepictures are taken under the same environment.

Further, in this embodiment, when the film is fed in the sequentialdirection, as shown in FIG. 5, the magnetic data are read/written andthe image data are read. However, the present invention should not belimited to this, when the film is fed in the reverse direction, as shownin FIG. 6, the image data of the index images may be read, the magneticdata may be written and the like, according to this case, the time, inwhich the film is loaded and the respective frames are edited and thefilm, then the film is picked up, can be reduced. In this case, sincethe film feeding directions of that the magnetic data are read andwritten are opposite, the sending order of the magnetic data whilewriting must be reversed.

Moreover, in this embodiment, the image data of the index images in thefilm taken with the pre-wind type camera are processed as shown in FIGS.8(C) and 8(D). However, the present invention should not be limited tothis, for example the feeding sequence of the film may be changed, andthen the image data and the like may be read while rewinding (whilefeeding the film in the reverse direction), as shown in FIG. 5.

Next, a description is given of the upright position of the frame whichis stored in the film is decided automatically.

As mentioned above, the point-sequential R, G, B signals are input tothe CPU 160 from the A/D convertor 150, and the signals are processedand the AE data and the like are detected. One frame is divided intonine areas, as shown in FIG. 15(A), based on the R, G, B signals, andthe data E11-E33 showing the brightness of each area is detected andprocessed as shown in FIG. 16 whereby the upright position of each frameis decided automatically.

That is, as shown in FIG. 16, the data E11-E33 of each frame are read(step 300), and the data X1, X3, Y1, Y3 showing the brightness of theperipheral four sides are calculated with the following formula(step302).

    X1=E11+E12+E13

    X3=E31+E32+E33

    Y1=E11+E12+E13

    Y3=E31+E32+E33

Then, four data X1, X3, Y1, Y3 are compared respectively in the steps304-316 to thereby decide the brightest side among the peripheral foursides. Then, it is decided by the brightest side which is closest to thesky or a illumination and the image stands in the direction of the side.That is, as shown in FIG. 15(B), when the side corresponding to the dataY1 among the arrows A, B, C, D showing the upright position isbrightest, the image is decided to stand in the direction of the arrowA, and when the side corresponding to the data Y3 is brightest, theimage is decided to stand in the direction of the arrow B, and when theside corresponding to the data X1 is brightest, it is decided that theimage stands in the direction of the arrow C, and when the sidecorresponding to the data X3 is brightest, it is decided that the imagestands in the direction of the arrow D.

In this way, the upright position of each frame is decided automaticallybased on the image data of each frame, which are obtained during thepre-scan. The CPU 160 can store the data showing the decided uprightposition in the RAM 160A and can rotate each frame in accordance withthe upright position of each frame.

And, the upright position, which are decided automatically as above, arenot always right, therefore, when the frame in which the uprightposition is incorrectly decided, it can be corrected by the key pad 120.And, in the film of one film cartridge, it is hard to accept that theframe whose image stands in the direction of the arrow A shown in FIG.15(B) and the frame whose image stands in the direction of the arrow Bare mixed, therefore, in this case, the direction may be unified by oneof them.

As previously described, with the film image input method and the systemthereof according to the present invention, a line sensor is used as animage sensor so that the cost can be reduced, further, takingenvironments of all frames in one film can be detected rapidly, wherebythe image data can be corrected based on the taking environment such asthe brightness and the white balance for every frame, which occurs whenusing the line sensor. The image data of all frames in one film can betaken rapidly so that the index images can be made at a short time,thus, the image can be edited consecutively and easily while monitoringthe index images. Incidentally, since the index images are not forenjoying, the quality thereof does not come into question, thus, theindex images can be understood enough from the rough image data which istaken rapidly.

According to the present invention, the film is fed at a high speedduring the pre-scanning and the film is fed at a low speed during thereal scanning, so that the magnetic data can be recorded in the magneticrecord layer of the film and can be reproduced easily, and the imagedata of all frames in one film can be taken rapidly, further, the fineimage data for one frame can be taken during the real scanning.

Further, according to the present invention, the order of the framenumber or the feeding sequence of the film is changed whether the filmis taken by a pre-wind type camera or not, so that the taking order canbe corresponded to the frame number usually, and the up right positionof every frame is determined automatically based on the data showing thebrightness in the frame, so that the direction of the frame can bedisplayed without correcting the direction with eyes or the correctingwith eyes can be reduced.

It should be understood, however, that there is no intention to limitthe invention to the specific forms disclosed, but on the contrary, theinvention is to cover all modifications, alternate constructions andequivalents falling within the spirit and scope of the invention asexpressed in the appended claims.

We claim:
 1. A film image input method, applied to a film having a magnetic record layer storing magnetic data and an optical data recording area storing, comprising the steps of:reading image data for every frame of the film; reading magnetic and optical data corresponding to a selected frame after developing the film; comparing, for the selected frame, the read magnetic data and the read optical data; and processing said image data of the selected frame in accordance with both the optical data and the magnetic data if the magnetic data and optical data represent different types of processing, and processing said image data of the selected frame in accordance with the magnetic data if the optical and the magnetic data represent the same type of processing but represent different designations therefor.
 2. A film image input system, applied to a roll of developed film having a magnetic record layer for storing magnetic data and an optical data memory area for storing optical data, wherein images of the developed film are focused on an image sensor through a taking lens and image signals, transferred photoelectrically by an image sensor, are output and displayed on a TV monitor,the film image input system comprising: film feeding means for feeding the film; magnetic record reproducing means for writing magnetic data on a magnetic layer of the film and for reading magnetic data written in the magnetic record layer while the film is being fed by the film feeding means; optical reading means for reading the optical data stored in the optical data memory area of the film; comparing means for receiving the magnetic data and the optical data read by the magnetic record reproducing means and the optical reading means respectively, and for comparing the read magnetic and optical data stored for a selected frame of the film; and processing means for processing said image of the selected frame in accordance with both the magnetic data and optical data if the optical data and magnetic data represent different types of processing and for processing said image of the selected frame in accordance with the magnetic data if the optical data and the magnetic data represent the same type of processing but represent different designations therefor.
 3. The film image input method of claim 1, further comprising the step of:displaying the processed image data.
 4. The film image input method of claim 3, further comprising the step of:editing the image data of the selected frame, wherein contents of the magnetic data are varied based upon the editing of the image data.
 5. The film image input method of claim 4, further comprising the steps of:displaying an index image including a plurality of frames of image data; and displaying editing information for editing a frame of the image data.
 6. The film image input method of claim 1, further comprising the step of:processing the image data of the selected frame based on the optical data when the compared magnetic and optical data, for a desired processing type, do not differ.
 7. The film image input method of claim 6, further comprising the step of:displaying the processed image data.
 8. The film image input system of claim 2, further comprising:editing means for editing the image of the selected frame, wherein contents of the magnetic data are varied based upon the editing of the image.
 9. The film image input system of claim 2, wherein the processing means processes the image of the selected frame based on the optical data when the compared magnetic and optical data, for a desired processing type, do not differ. 